Compressed Sensing with off-axis frequency-shifting holography 
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This work reveals an experimental microscopy acquisition scheme successfully combining Compressed Sensing 
(CS) and digital holography in off-axis and frequency-shifting conditions. CS is a recent data acquisition 
theory involving signal reconstruction from randomly undersampled measurements, exploiting the fact that 
most images present some compact structure and redundancy. We propose a genuine CS-based imaging 
scheme for sparse gradient images, acquiring a diffraction map of the optical field with holographic microscopy 
and recovering the signal from as little as 7% of random measurements. We report experimental results 
demonstrating how CS can lead to an elegant and effective way to reconstruct images, opening the door for 
new microscopy applications. OCIS : 070.0070, 180.3170 © 2010 Optical Society of America 
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General high resolution microscopy involves dense data 
acquisition. One intense field of research aims to re- 
duce the amount of data acquisition or sample illu- 
mination [1, 2]. In [1], the acquisition is restricted to 
only those areas where relevant signal is present. In [2] 
a method called controlled light-exposure microscopy 
(CLEM) is introduced, supported by a nonuniform il- 
lumination of the field of view. However, both methods 
suffer from being image-content dependent for a suc- 
cessful implementation. Indeed, these methods need a 
feedback loop inside the acquisition setup to make de- 
cisions about the sampling rate or the illumination in- 
tensity, depending on the objects characteristics. Here, 
we address the sensing problem in microscopy by tak- 
ing an alternative approach provided by the new the- 
oretical framework of Compressed Sensing (CS). This 
method is independent of image-content and does not 
need any feedback loop during the acquisition. CS was 
previously reported in magnetic resonance imaging ac- 
quisition [3], single-pixel imaging [4] or inline, single-shot 
holography for tridimensional imaging [5] . The main idea 
presented here is to combine off-axis, frequency-shifting 
(for accurate phase-shifting) digital holography to per- 
form quadrature-resolved random measurements of an 
optical field in a diffraction plane and a sparsity mini- 
mization algorithm to reconstruct the image. 

CS is a novel mathematical theory for sampling and 
reconstructing signals in an efficient way, introduced by 
Candes and Donoho [6-8]. It exploits the fact that most 
images are compressible or sparse in some domain due 
to the homogeneity, compactness and regularity of struc- 
tures. Instead of sampling the entire data and then com- 
press it to eliminate redundancy, CS performs a com- 
pressed data acquisition. Some basic requirements to 
enable Compressed Sensing are (i) to find a sparsify- 
ing transform able to shrink the data into a small num- 
ber of coefficients (ii) to acquire random projections of 



the signal into orthogonal subspaces, such as the Fourier 
domain for spatially-sparse images (iii) to use a sam- 
pling scheme that obeys the Restricted Isometry Prop- 
erty (RIP) [9] and (iv) to use a sampling domain and a 
sparsifying transform that span incoherent domains (i.e. 
domains where the signal is dense in one case and sparse 
in the other one) [6]. 

Complying with these requirements, CS states that 
a signal g G ^ N having a 5-sparse representation (i.e. 
it can be well represented by a small number S of co- 
efficients, where S <C N) on a basis can be recon- 
structed very accurately from a small number of projec- 
tions of g onto randomly chosen subspaces (e.g. Fourier 
measurements for spatial sparsity) . More precisely, a sig- 
nal g has a sparse representation if it can be written as 
a linear combination of a small set of vectors taken from 
some basis such as g = J^c^i, with || c \\ £ « 5, 
where || • denotes the i\ norm which corresponds to 
the sum of magnitudes of all terms of the candidate sig- 
nal g projected on In general, the £ p norm is defined 
as || c := {£f =1 | Ci |n 1/p . 

As demonstrated in [8] , if such a sparsifying transform 
^ exists in the spatial domain, it is possible to recon- 
struct an image g from partial knowledge of its Fourier 
spectrum. In our case, g will represent the local optical 
intensity in the object plane. We denote / G the as- 
sociated complex optical field, satisfying g = \f\ 2 . The 
radiation field propagates from the object to the detector 
plane in Fresnel diffraction conditions. Thus, the optical 
field in the object plane / is linked to the field F in the 
detection plane by a Fresnel transform, expressed in the 
discrete case as: 
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where n,p G {1,...,7V} denote pixel indexes, a G R + 

2 

is the parameter of the quadratic phase factor e ian de- 
scribing the curvature in the detection plane of a wave 
emitted by a point source in the object plane. In CS, the 
signal reconstruction consists in solving a convex opti- 
mization problem that finds the candidate g ( : denotes an 
estimator) of minimal complexity satisfying ,F|r = -F|r> 
where F\r C F is a partial subset of measurements in 
the set T. 

The experimental setup is sketched in Fig. 1. It con- 
sists of an off-axis, frequency-shifting digital hologra- 
phy scheme [10, 11]. The monochromatic optical field 
from a diode laser dynamically backscattered by an in- 
tralipid emulsion illuminates an US Air Force (USAF) 
resolution target, beats against a separate local oscilla- 
tor (LO) field detuned by Acj/(27t) = 200 Hz and creates 
a time-fluctuating interference pattern measured with a 
N = 1024 x 1024 array detector. The diffracted object 
field map in the detector plane, resolved in quadrature 
(in amplitude and phase) F G is calculated from 
a four-phase measurement [10]. The frequency detun- 
ing Au enables rejection of non fluctuating light compo- 
nents reflected by the target as well as speckle reduction 
through signal accumulation. 

F can be back-propagated numerically to the target 
plane with the standard convolution method when all 
measurements F G are available. In this case, the 
complex field in the object plane / is retrieved from a 
discrete inverse Fresnel transform of F\ f = J r ~ 1 (F) : 



from holography: 
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Now returning to the CS reconstruction problem, we 
want to recover the intensity image of the object g = 
{\f\ 2 : / G C^} from a small number of measurements 
F\r G C M where M«iV. Partial measurements in the 
detection plane, illustrated by the first step in Fig. 2, can 
be written as F\r = where the sampling matrix $ 
models a discrete Fresnel transform (eq. 1) and random 
undersampling with flat distribution. To find the best 
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F\r = F(f)\r Signal candidate g 

Iterative Reconstruction 

Fig. 2. CS reconstruction scheme. 



estimator g, we solve the following convex optimization 
problem [12]: 
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(3) 



This optimization leads to an iterative image reconstruc- 
tion process, illustrated by the loop inside the dotted 
frame in Fig. 2. Explicitly, given a partial knowledge of 
the Fresnel coefficients F\r, we seek a solution g with 
maximum sparsity (i.e. with minimal norm || Sfrg ||^), 
and whose Fresnel coefficients F\r match the subset ob- 
served F|r (as illustrated in Fig. 2). Since our test im- 
age is piecewise constant with sharp edges (such as most 
microscopy images), it can be sparsely represented com- 
puting its gradient. In image processing, a suitable norm 
to constrain the gradient of an image was introduced as 
the Total Variation (TV) which measures the t\ norm of 
the gradient magnitudes over the whole image: 
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Fig. 1. Sketch of the experimental image acquisition 
setup. 
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The incoherence property holds for the two basis adopted 
here, which are the Fresnel spectrum and the TV [6]. 
Moreover, random measurements in the spectral domain 
satisfy the RIP condition [9]. Hence for overwhelming 
percentage of Fresnel coefficients sets T with cardinality 
obeying |T| = M > K • S log N, for some constant K, g 
is the unique solution to the problem: 



arg min || V# L subject to F\r = F\r 



(4) 



However, holographic measurements are corrupted with 
noise and the observed signal is not exactly sparse. More 
appropriately, the observations can be described by noisy 
measurements F|r = <&f + n, where n G 



M is a noise 
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component with bounded energy || n \\ £ < e. In this par- 
ticular case, a better reconstruction can be achieved by 
relaxing the constraint F|r = F\r and allowing an er- 
ror S at most proportional to the noise energy e [13, 14]. 
Finally, solving the following problem performs the re- 
construction of g with robustness to noise: 

g = arg min || Vg \\ £i subject to || F| r - F| r \\ t2 < S 

(5) 

for some S < Ce, which depends on the noise energy. 

In Fig. 3 we illustrate some CS reconstruction results. 
A reconstruction of an off-axis image with the stan- 
dard convolution method (eq. 2) is illustrated in Fig. 
3a. The image reconstructed with holography uses all 
available measurements (4 phases x 10 accumulations 
xl024 2 = 4.2 x 10 7 pixels). For the CS approach, Fresnel 
coefficients are undersampled randomly. Fig. 3b shows 
the CS reconstruction result from only 7% of the pixels 
used in the standard approach (4 phases x 10 accumu- 
lations x 0.07 xl024 2 = 2.9 x 10 6 pixels). Fig. 3c illus- 
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Fig. 3. (a) Standard holography, as described in Eq. (1). 
(b) CS reconstruction, using 7% of the Fresnel coeffi- 
cients, (c) Gradient of g. (d) Residual from (a) and (b). 
(e), (f) Magnified views from (a) and (b). 



trates the gradient of the image Vg (sparsifying domain) 
and Fig. 3d illustrates the residual (Euclidean distance 
\g — g\) from standard holographic reconstruction (a) and 
CS reconstruction (b). The global normalized error is 
II 9 ~ 9 \\i 2 — 0.005 (g and g have unit norms). This er- 
ror is essentially due to the relaxation of the constraint 
for a perfect match between measures and estimations 
in the CS scheme, leading to some denoising effect, con- 
firmed by the visual aspect of the residual image image 
Fig. 3d showing essentially unstructured noise. Finally, 
Figs. 3e and 3f display magnified views from central re- 
gion of images (a) and (b), illustrating the quality of the 
reconstruction. 

In conclusion, we have presented a novel microscopy 
imaging framework successfully employing Compressed 
Sensing principles. It combines an iterative image recon- 
struction and digital holography to perform quadrature- 
resolved random measurements of an optical field in a 
diffraction plane. The CS approach enables optimal im- 
age reconstruction while being robust to high noise lev- 
els. The proposed technique is expected to greatly im- 
prove many microscopy applications, allowing the acqui- 
sition of high dimensional data with reduced acquisi- 
tion time increasing imaging throughput and opening 
the door to sample-friendly acquisition protocols. 
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